NORMALIZ: ALGORITHMS FOR AFFINE MONOIDS 
AND RATIONAL CONES 



WINFRIED BRUNS AND BOGDAN ICHIM 

Abstract. Normaliz is a program for the computation of Hilbert bases of rational cones 
and the normalizations of affine monoids. It may also be used for solving diophantine 
linear systems. In this paper we present the algorithms implemented in the program. 



1. Introduction 

The program Normaliz got its name from the first task for which it was designed: the 
computation of normalizations of affine monoids (or semigroups in other terminology). 
This task amounts to the computation of the Hilbert basis of the monoid of lattice points 
in a rational cone C with given generating system x\,...,x n (see for Section [2] for termi- 
nology and [2] for mathematical background). Such cones can be described equivalently 
by homogeneous linear diophantine equations and inequalities, and the computation of 
the normalization is equivalent to solving such systems. 

The mathematical aspects of the first implementation of Normaliz have been docu- 
mented in (8]|. In this paper we present the algorithms that have been added or modified 
in version 2.0 and later. Further extensions, for example parallelization of time critical 
steps, are still experimental; they will be presented in 01. 

As any other program that computes Hilbert bases, Normaliz first determines a system 
of generators of the monoid. Section [3] describes Normaliz' approach for the reduction 
of the system of generators to a Hilbert basis — often (but not always) the most time con- 
suming part of the computation. Section |4] contains our implementation of the Fourier- 
Motzkin elimination, which is tuned for obtaining best results in the case when most of 
the facets are simplicial. (Fourier-Motzkin elimination computes the convex hull of a 
finite set of points, or, in homogenized form, the support hyperplanes of a finitely gen- 
erated cone.) We need this variant for the new algorithm by which /z-vector and Hilbert 
polynomial are computed. It is based on line shellings and will be presented in Section [6] 
Finally, our implementation of Pottier's algorithm Ifl4l is presented in Section |7J In our 
interpretation, this "dual" algorithm is based on a representation of the cone as an inter- 
section of halfspaces, whereas the "primal" algorithm of Normaliz starts from a system 
of generators. 

The first version of Normaliz was a C program created by Winfried Bruns and Robert 
Koch in 1997-1998 and extended in 2003 by Witold Jarnicki. Version 2.0 (2007-2008) 
was completely rewritten in C++ by Bogdan Ichim. Pottier's algorithm for solving sys- 
tems of inequalities and equations was added in version 2.1. Christof Soger enhanced the 
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user interface in version 2.2, the currently public version. The distribution of Normaliz 
||5l contains a Singular library and a Macaulay2 package; for the latter, written by Gesa 
Kampf, see [7 j. Andreas Paffenholz provided a polymake interface to Normaliz |[T3l . 

We wish to thank all colleagues who have contributed to the development of of Nor- 
maliz. 

2. Affine monoids and their Hilbert bases 

We use the terminology introduced as in 0, but for the convenience of the reader 
we recall some important notions. A rational cone C C M. d is the intersection of finitely 
many linear halfspaces Ht = {x E R. d : X (x) > 0} where A is a linear form with rational 
coefficients (with respect to the standard basis of R d ). By the theorem of Minkowski- 
Weyl (for example, see 1.15]), we can require equivalently that C is of type R + x\ + 

h R+Xn with Xi E Q d , i = 1 , . . . , n. In this case, x\, . . . ,x n form a system of generators 

for C. If C can be generated by a linearly independent set of generators, we say that C is 
a simplicial cone. If dimC = d, then the halfspaces in an irredundant representation of 
C as an intersection of halfspaces are uniquely determined, and the corresponding linear 
forms Xj are called support forms of C, after they have been further specialized such that 
A ; (gp(M)) = Z. If gp(M) = li i , the last condition amounts to the requirement that the 
Xi have coprime integral coefficients. (Such linear forms are called primitive.) In the 
following all cones are rational, and we omit this attribute accordingly. A cone is pointed 
if x,—x EC implies x = 0. 

An affine monoid M is finitely generated and (isomorphic to) a submonoid of a lattice 
Z d . By gp(M) we denote the subgroup generated by M, and by rankM its rank. The 
support forms 0\ , . . . , <J S of the cone IR + M C MM are called the support forms ofM. They 
define the standard map 

o:M^Z s + , a(x) = (oi (*),..., CT a (x)). 

We introduce the total degree tdegx by tdegx = 0\ (x) H h a s (x) . (In the total degree 

is denoted T.) 

The unit group U(M) consists of the elements x EM for which —xEMas well. It is 
not hard to see that x E U(M) if and only if o(x) = (see [2, 2.14]), in other words, if 
and only if tdegx = 0. (However, in general tdegx = tdegv does not imply x — yE U(M) 
since x — y need not belong to M.) One calls M positive if U(M) = 0. 

An element x E M is irreducible if x U(M) and a representation x = y + z with y.zEM 
is only possible with y E U(M) or z E U (M). 

In the next definition we extend the terminology of slightly. 

Definition 1. Let M be a (not necessarily positive) affine monoid. A subset H of M is a 
system of generators modulo U(M) if M = Z + H + U(M), and H is a Hilbert basis if it is 
minimal with respect to this property. 

A Hilbert basis is necessarily finite since M has a finite system of generators. Moreover, 
every system of generators modulo U(M) contains a Hilbert basis. Often we will use the 
following criterion (see 2.14]). 
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Proposition 2. H C M is a Hilbert basis if and only if it is a system of representatives of 
the nonzero residue classes of the irreducible elements modulo U(M). 

The Hilbert basis of a positive affine monoid is uniquely determined and denoted by 
Hilb(M). 

Suppose N is an overmonoid of M. Then we call y EN integral over M if ky E M for 
some k E Z, k > 0. The set of elements of N that are integral over M form the integral 
closure M^ of M in N; it is itself a monoid. The normalization M of M is its integral 
closure in gp(M), and if M = M, M is called normal. 

If M is normal, the case in which we are mainly interested, then M splits in the form 
U(M) © a(M) (see [|2l 2.26]) and we can state: 

Proposition 3. Let M be a normal affine monoid with standard map o : M — > 7A_. Then 
H C M is a Hilbert basis ofM if and only ifo maps H bijectively onto a Hilbert basis of 
a{M). 

It is a crucial fact that integral closures of affine monoids have a geometric description 
(see El 2.22]): 

Theorem 4. Let M CN be submonoids ofQ d , and C = R + M. 

(1) Then M N = CON. 

(2) IfM and N are affine monoids, then is affine, too. 

The second statement of the theorem is (an extended version of) Gordan's lemma. 

The program Normaliz computes Hilbert bases of monoids of type C fl L where C is 
a pointed rational cone specified either (i) by a system x\, . . .,x n E 7r or (ii) a system 
<J\ , . . . , <7j E (R d )* of integral linear forms, and L is a lattice that can be chosen to be 

either Z, d or, in case (i), Zjci H +7jc n . We will simply say that Normaliz computes 

Hilbert bases of rational cones. If C is pointed and their is no ambiguity about the lattice 
L, then we simply write Hilb(C) for Hilb(CnL). 

Once a system of generators of C is known (either from the input data or as a result of 
a previous computation), Normaliz reduces this computation to the full-dimensional case 
in which dimC = rankL and, and introduces coordinates for the identification L — Z ran ^ L . 
The necessary coordinate transformations are discussed in j8l Section 2]. 

3. Reduction 

All algorithms that compute Hilbert bases of rational cones cannot avoid to first produce 
a system of generators that is nonminimal in general. In a second, perhaps intertwined, 
step the system of generators is shrunk to a Hilbert basis. This approach is based on the 
the following proposition. Let us say that y EM reduces x E M if y U(M), x^y, and 
x — yEM. 

Proposition 5. Let M be an affine monoid (not necessarily positive or normal), E EM a 
system of generators modulo U(M), andx E E. Ifx is reduced by some y EE, then E \ [x] 
is again a system of generators modulo U(M). 

Proof. Note that E contains a Hilbert basis. It is enough to show that E \ {x} contains a 
Hilbert basis as well. If x — y £ U(M), then x is reducible, and does not belong to any 
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Hilbert basis, and if x — y E U(M), we can replace x by y in any Hilbert basis H C E to 
which x belongs. □ 

The proposition shows that one obtains a Hilbert basis from a set E of generators mod- 
ulo U(M) by (i) removing all units from £, and (ii) successively discarding elements x 
such that x — yEM for some y E E, x ^ y. After finitely many reduction steps one has 
reached a Hilbert basis. 

The difficult question is of course to decide whether x E U(M) or x — y E M. However, 
if M = C fl L with a rational cone C C M. d , and a sublattice L of Q rf , then this question is 
very easy to decide, once the support forms 0\ , . . . , o s of C are known: 

x — yEM •<=>- x — y EC •<=>■ Gi(x — y)>0,i=l,...,s, 

and 

jc E U(M) <^=^ Oi(x) = 0, z = 1 , . . . , 5. 

Therefore, if C is given by a set of generators, the necessity of reduction forces us to com- 
pute the support forms of C. Normaliz's approach to this task is discussed in SectionHl 

It is very important for efficiency to make reduction as fast as possible. Normaliz uses 
the following algorithm. The elements forming a system of generators are inserted into 
a set E ordered by increasing total degree such that at the end of the production phase E 
contains at most one element from each residue class modulo U(M) (and no element from 
U(M)). Let E = {xj, . . . ,x m }. Then a Hilbert basis H is extracted from E. Initially, H is 
the set of elements of minimal total degree in E, say H = {y\,. . . ,y u } = {x\, . . .,x u }. For 
i = u + 1 , . . . , m the element x\ is compared to the dynamically extended and reordered list 
H = {yi . . .,y n } as follows: 

(Rl) forj = l,...,n, 

(a) if tdegx,- < 2tdeg yj, then x ; is appended to H as y n+ \ ; 

(b) if Xi-yj E M, then H is reordered as H = {yj,yi, . . . ,yj-uy j+ u ■ ■ -,yn}\ 
(R2) if (i) or (ii) does not apply for any j, then xi is appended to H as y n +i . 

For the justification of this procedure, note that x — y EM for some y with 2 tdeg y < tdegx 
if x is reducible. Therefore (Rl)(a) can be applied, provided 2tdegy£ > tdegx; for all 
k > j- This holds since E is ordered by ascending degree, the fact that no element in H 
that follows yj has been touched by the rearrangement in (Rl)(b): only elements with 
2tdegy ; < tdegx, have been moved, and tdegx,- < tdegx^ for all k > i. 

Remark 6. (a) The "darwinistic" rearrangement in (Rl)(b) above has a considerable ef- 
fect as all tests have shown. It keeps the "successful reducers" at the head of the list. 
Moreover, successive X[ are often close to each other (based on empirical evidence), so 
that yj has a good chance to reduce jc 7+ i if it reduces x,-. 

(b) Instead of tdeg one can use any other convenient positive linear form t:M4 M+ 
with the property that r(y) = ^ y E U (M) . 

In Section [7] we will encounter a situation in which the subset E to which reduction is 
to be applied need not to be a system of generators. Then we call a subset E' an auto- 
reduction of E, if E' n U(M) = and no element of E' is reduced by another one. 
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4. Computing the dual cone 

Let C C M. d be a rational cone and L C Z d a lattice. In order to perform the reduction 
of a system of generators of the normal monoid C fl L to a Hilbert basis, as discussed in 
the previous section, one must know the hyperplanes that cut out C from Mr, or rather 
the integral linear forms defining them. These linear forms generate the dual cone C* in 

(m d y. 

Conversely, if C is defined as the intersection of half-spaces represented by a system of 
generators of C*, then the use of an algorithm based on a system of generators of C makes 
it necessary to find such a system. Since C = C** (see fl2l 1.16]), this amounts again to 
the computation of the dual cone: the passage from C to C* and that from C* to C can be 
performed by the same algorithm. 

In the following we take the viewpoint that a full-dimensional pointed rational cone 
C C M d is given by a system of generators E, and that the linear forms generating C* are 
to be computed. Normaliz uses the well-known Fourier-Motzkin elimination for this task, 
however with a simplicial refinement that we will describe in detail. 

Fourier-Motzkin elimination is an inductive algorithm. It starts from the zero cone, and 
then inserts the generators xi,...,x n successively, transforming the support hyperplanes 

of C' = R+xi H |-1+a;„_i into those of C = M + x\ H hR+x ra . The transformation is 

given by the following theorem; for example, see fl2] pp. 1 1,12]. 

Theorem 7. Let C be generated by x\ , . . . , x n and suppose that C' = M + xi H h M+x„_ i 

is cut out by linear forms X\, . . . , X m . Let 2? = {Xi : A;(x n ) > 0}, J/ = {Xi : Xi(x n ) < 0}, 
and 3? = {Xi : Xi(x n ) = 0}. Then C is cut out by the linear forms in the set 

0>u2?u {Xj(x n )Xj - Xj(x n ) Xi : X t e Xj e ^Y}. 

In this raw form the algorithm produces \&\ ■ \JV\ linear forms, from which the new 
facets have to be selected. While the complexity of this algorithm may seem negligible 
in view of the subsequent steps in the Hilbert basis computation, this is no longer so if 
applied in the computation of a shelling of C (see Section©. But in the computation of 
a shelling the boundary of (a lifting of) C consists mainly of simplicial facets, and this 
allows an enormous acceleration. (The construction of the lifting ensures that most of its 
facets are simplicial; see Remark [L2l) 

In a geometric interpretation of Fourier-Motzkin elimination, we have to find the bound- 
ary V of that part of the surface of C' that is visible from x n , or rather the decomposition of 
V into subfacets (faces of C of dimension d — 2). Figure Q] illustrates the inductive step of 
Fourier-Motzkin elimination in the three-dimensional cross-section of a four-dimensional 
cone. The area of the "old" cone visible from the "new" generator x$ is the union of the 
cones spanned by the triangles [^1,^4,^2] an d [^2,^4,^3], whereas V is the union of the 
cones over the line segments forming the cycle [xi,X4,X3,X2,xi\. 

Each subfacet S of C' is the intersection of two facets F and G and we call F and G 
partners with respect to S. In order to compute the new facets of C we have to find those 
subfacets S of C' whose two overfacets belong to 2? and jV , respectively. The new facets 
of C are then the cones M+(5U {x n }). 

Let E' be the subset of E \ {x n } whose elements are contained in a hyperplane belonging 
to & as well as in a hyperplane belonging to jY . Clearly, a facet F of C' can only 
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Figure 1 . Cross-section of extension of the cone 



contribute to a new facet of C if \F (1E'\ > d — 2. While this observation is useful (and is 
applied), its effect is often rather limited. 

Normaliz proceeds as follows; for simplicity we will identify subsets of E with the 
faces they generate. 

(Dl) It separates the facets in 3? and jV into the subsets ^ s i mp and o/^j mp of simplicial 
ones and the subsets ^nonsimp an d ^onsimp of nonsimplicial ones, discarding those facets 
that do not satisfy the condition \F C\E'\ >d — 2. 

(D2) All subfacets of all the facets N £ ^Kimp are formed by simply taking the subsets 
S of cardinality d — 2 of NHE (which has cardinality d — 1 in the simplicial case). The 
pairs (S,N) are stored in a set ordered by lexicographic comparison of the components S. 
In fact, if S appears with a second facet N' £ ^i m p> then it cannot belong to V, and both 
pairs (S,N) and (S,N') can be discarded immediately. Forming the ordered set 2? is of 
complexity of order q log 2 q where q = (d — l)\ ^Kimp I ■ 

(D3) Each pair (S,N) £ 3~ is compared to the facets in G £ ^onsimp U 3f: if S C G, 
then the partner of F with respect to S does not belong to and (S,N) can be deleted 
from (In the critical situation arising from the computation of a shelling, the sets 
-^nonsimp and 2£ are usually short.) 

(D4) At this point contains only pairs (S,N) such that the partner of Af with respect 
to S indeed belongs to 3?, and therefore gives rise to new facet. It remains to find the 
partners. 

(D5) Normaliz now produces all subfacets S of the facets P £ ^ s imp and tries to find S 
as the first component of an element in the set ST. This search is of complexity of order 
{d-\)-\ 

^simpl ' l°g2 < ?' Q as aDove - 

If the search is successful, a new facet of C is produced, and the pair (S,N) is discarded 
from & . 

(D6) To find the partners in ^ n0 nsimp f° r me remaining pairs (S,N) in 3T, the sets S are 
compared to the facets £P in ^nonsimp- This comparison is successful in exactly one case, 
leading to a new facet. 

(D7) Finally, the facets £ ^nonsimp are paired with all facets P £ & , as described in 
Theorem [71 and whether a hyperplane H produced is really a new facet of C is decided by 
the following rules, applied in the order given: 
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(i) if \NHPnE\ <d-2, then H can be discarded; 

(ii) if j N n P n E j = d - 2 and P e ^ s imp, then H is a new facet; 

(iii) H is a new facet if and only if rank(yV DPDE) — d — 2; 

(iv) (alternative to the rank test) H is a new facet if and only if the only non-simplicial 
facets containing NOP are N and P. 

Which of the tests (iii) or (iv) is applied, is determined as follows: if the number of 
nonsimplicial facets is < d 3 , then (iv) is applied, and otherwise the rank test is selected. 

It is not hard to see that (iv) is sufficient and necessary for N fl P to have dimension 
d — 2. Indeed, a subfacet is contained in exactly two facets, and if we have arrived at step 
(iv), PDN cannot be contained in any simplicial facet G: since PD N > d — 2, it must be 
a subfacet contained in G, and it would follow that P = G or N = G, but both P and N are 
nonsimplicial. 

Remark 8. (a) Computing the dual cone is essentially equivalent to computing the convex 
hull of a finite set of points: instead of the affine inhomogeneous system of inequalities we 
have to deal with its homogenization. Therefore one could consider other convex hull al- 
gorithms, like "gift wrapping" or "beneath and beyond" (see lfl2ll for their comparison to 
Fourier-Motzkin elimination). The main advantages of Fourier-Motzkin elimination for 
Normaliz are that it does not require (but allows) the simultaneous computation of a tri- 
angulation, and furthermore that the incremental construction of C, adding one generator 
at a time, can be used very efficiently in some hard computations (see flU). 

(b) One can extend the idea of the simplicial refinement and work with a triangulation of 
the boundary of C' that is then extended to a triangulation of the boundary of C, accepting 
that a facet may decompose in many simplicial cones. In this way the pairing of "positive" 
and "negative" facets can be reduced to the creation of a totally ordered set and the search 
in such a set. In our tests the separate treatment of simplicial and nonsimplicial facets 
turned out superior. 

5. The primal Normaliz algorithm 

The primal algorithm of Normaliz proceeds as follows (after the initial coordinate 
transformation discussed in [8, Section 2]), starting from a system of generators x\,...,x n 
ofC: 

(Nl) the support hyperplanes of C are computed as described by Fourier-Motzkin elim- 
ination (Section HI); 

(N2) intertwined with (Nl), the lexicographic (or placing) triangulation of C is com- 
puted into which the generators xi, .. . ,x n are inserted in this order; 
(N3) for each simplicial cone D in the triangulation Hilb(D fl Z d ) is determined; 
(N4) the union of the sets Hilb(D n Z d ) is reduced to Hilb(C). 

After the completion of (Nl) one knows C* and can decide whether C is pointed since 
pointedness of C is equivalent to full-dimensionality of C* (see fl2] 1.19]). 

In step (N2) the lexicographic triangulation £' of C' = R+jci, hM + jc„_i is extended 

to a lexicographic triangulation E of C = JLpci, V WL+x n as follows: Let F\, .. . ,F V be 

those facets of the maximal cones in £' that lie in the facets of C visible from x n : then 
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E = E' U {Fi + R + x n : i = 1, . . . , v}. (If x n G C, then C = C and E = E'.) (Compare 
p. 267] for lexicographic triangulations.) This construction is illustrated by Figure[2] 




Figure 2. Extension of triangulation 

It only remains to explain how a set Eo of generators of D n lr is determined if D is 
simplicial, i.e., generated by a linearly independent set V = {v\, . . . , Vd} C Z d . Following 
the notation of [2], we let 

par(vi,...,v d ) = {aivi H \-a d v d : Q<a t < 1, i= 1,..., d} 

denote the semi-open parallelotope spanned by vi, . . . , v^. Then the set 

E = E D = par(v h ...,v d )nZ d (5.1) 

generates DnZ rf as a free module over the free submonoid Z + vi H h Z+v^. In other 

words, every element zE DC\Z d has a unique representation 



z = x+ J^a/v,-, x £ E, di E Z + . 



(5.2) 



See [2, 2.43] for this simple, but crucial fact. Clearly E\J{v\,...,Vd} generates the 
monoid D D Z rf . Figure [3] illustrates the construction of E. 




Figure 3. The semi-open parallelotope and the set E 
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The efficient computation of Ed has been discussed in O; it amounts to finding a 
representative z for each residue class in Z d / (£ Zv ; ) and reducing it modulo vi , . . . , to 
its representative in par(vi , . . . , v^) . 

In the following the attribute local refers to the simplicial cones D whereas global refers 
toC. 

While the primal algorithm had been realized already in the first version of Normaliz 
(see [81), it has now undergone several refinements. 

Remark 9. (a) The lexicographic triangulation is used by Normaliz in its "normal" (mean- 
ing "standard") computation type. It is replaced by a shelling if the /z-vector is to be 
computed (see Section©. 

(b) The total number of vectors generated by Normaliz is the sum of the multiplicities 
jii(D) = | det(vi, . . -,Vd)\ of the simplicial cones D in the triangulation. If the monoid is 
defined by a lattice polytope P, then this number is the Z rf -normalized volume of P, and 
therefore independent of the triangulation. (This count includes the zero vector in each 
simplicial cone; therefore the number of simplicial cones should be subtracted from the 
sum of multiplicities.) 

6. h- VECTORS VIA SHELLINGS 

For iVcR^we set 

H N (t)= £ f. 

Here we use multi-exponent notation: t x = t* 1 ■ • -f/ . The formal Laurent series is simply 
the "characteristic series " of the set N DZ d C Z d . If N is an "algebraic" object (for 
example, an affine monoid), then we can interpret H^(t) as the multigraded Hilbert series 
ofN. 

Let C be a cone and M = C D Z d . Suppose that C is triangulated by the conical com- 
plex the standard situation in the primal algorithm of Normaliz. If C\ , . . . , C m are the 
maximal cones in c to, then 

m 

H M {t) = Y t H Dl (t), A = Cf\(CiU---UCi_i), i= l,...,m. (6.1) 

i=\ 

Within Q, the set £),•, i = 1 , . . . , m, is the complement of the union of the sets of faces of 
Ci , . . . , Ci-\. Therefore it is the union of the (relative) interiors of those faces of C ; that are 
not contained in C\ U • •• UC,_i. In order to compute Hjy.tf), one has to solve two prob- 
lems: (i) to compute flint/3 (f) f° r a simplicial cone D, and (ii) to find the decomposition 
of Di as a union of interiors of faces of C ; -. 

As in Section [5] we denote the linearly independent generators of the simplicial cone 
D by vi,. .. ,Vd and consider the system of generators E = Eq. For a subset Y of V = 
{vi,...,v d },let 

M(t)=H z+Y (t) = H-^— and t Y =\[f. 
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By definition, J^y(t) is the Hilbert series of the free monoid generated by Y. In view of 
equation (15.21) one obtains 

Now problem (i) is easily solved (compare [2, p. 234]): 

H mm = (-i) dimD H D (r l ) = m{t) £ f*+~+*-*. 

Problem (ii) is very hard for an arbitrary order of the cones C, in the triangulation. How- 
ever, it becomes easy if C\ , . . . , C m is a shelling. Shellings are the classical tool for the 
investigation of /z-vectors, as demonstrated by McMullen's proof of the upper bound the- 
orem (see [3l or lfT5lO . We need the notion of shelling only for complexes of simplicial 
cones (or polytopes), for which it reduces to a purely combinatorial condition. 

Definition 10. Let ^ be a complex of simplicial cones (or polytopes) whose maximal 
cones have constant dimension d. An order C\,...,C m of the maximal cones in ^ is 
called a shelling if QCl (C\ U • • • U Q-\) is a union of facets of Q for all i. 

The next lemma solves problem (ii) for a shelling. For a compact formula we need one 
more piece of notation: for x G E, x = a\V\ H V cijVd, let 

[x] = { Vi : a t / 0}. 

Lemma 11. Let D cM. d be a simplicial cone of dimension d generated by the linearly 
independent set V = {vi , . . . , v^} C 7L d . Let G be the union of some facets F ofD, and set 
W = \J FcG V\F. Then 

H D \ G {t)=^ v (t)Y,t- x t W[J[x] 

xeE 

x<EE 

Proof Let Y C V = {v\, . . . , v^}. For simplicity of notation we set 

E(Y) = par(y) n Z d = {x E E : [x] C Y}, 

Moreover, note that since D is simplicial, a face of D is not contained in G if and only if 
it contains W. 
Then 

H D \ G = £ ff int(K+y) (*)= £ £ * y r^ y (*)=£r* £ ^(*) 
= £r^ u Hjr wuH (0 £ 

x<EE ZcV\(WU[x\) 

= j^(0£rV aj H 

The proof of the second formula is actually simpler. Let L be the free monoid generated 
by vi , . . . , Vd . Then D fl Z d = Y, x eE x + L. Now one computes (x + L)\ G, and obtains the 
result. □ 
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In the present implementation Normaliz uses the first formula in Lemma [TH but only 
in the case in which there is an integral linear form 7 such that the given generators of 
the cone C have value 1 under 7 (this case is called homogeneous). Then 7 induces a 
Z-grading on M = C fl 7L d in which all generators of all the simplicial cones C\ , . . . , C m in 
the triangulation have degree 1, and Lemma ITTI specializes to 

H Ci \ G (t) = j^— d £ t\^\-^ = — * £ fWHI-H** (6 .2) 

Therefore one needs only to count each element x EE (including 0!) in the right degree 
to obtain the /z-vector of the cone C. 

The price to be paid for the simple computation of the /z-vector is the construction of a 
shelling. The classical tool for this purpose is a line shelling as introduced by Brugesser 
and Mani. 

First we "lift" the cone C C W l generated by vi , . . . , v m to a cone C' C IR rf+1 by extend- 
ing the generating elements by positive weights: 

J i = {v i ,w i )eZ d+1 , Wi >0. 

The bottom B of C' is the conical complex formed by all the facets (and their faces) that 
are "visible from below", more precisely by all the facets F of F' whose corresponding 
support form Of E (IR rf+1 )* has positive last coordinate. The projection M. d+l — > M. d , 
(ci, . . . ,fld+i) i-> (ai,...,aj), maps B bijectively onto C, and the images of the facets 
constitute a conical subdivision of C. We always choose the weights in such a way that 
the facets in the bottom of C' are simplicial, and therefore we obtain a triangulation of C. 
(This is the classical construction of regular triangulations; compare fl2l l.F].) 

It follows from [fT5l Theorem 8.1] that this triangulation is shellable, and in order to 
reduce our conical situation to the polytopal one in |fT5l , one simply works with a suitable 
polytopal cross-section of C'. 

Remark 12. Although it is superfluous, we also keep the "top" of C' simplicial by a suit- 
able choice of weights. The only facets of C' that cannot always be made simplicial are 
"vertical" ones, namely those parallel to the direction of projection. Each vertical facet of 
C' corresponds to a (non- simplicial) facet of C whereas the bottom and top facets corre- 
spond to the simplicial cones in triangulations of C. Since such triangulations usually have 
many more cones than C has support hyperplanes, C' has mainly simplicial facets, and for 
this reason we have developed the simplicial refinement of Fourier-Motzkin elimination 
in Section HI 

The proof of |[T5l Theorem 8.1] tells us how to find a shelling. We choose a point 
x E int(C') such that the ray x + ~R + v, v = (0, ... ,0, — 1) E Mr + , is intersected at pairwise 
different points x + tpv by the linear subspaces EF where F runs through the facets in the 
bottom. Then we order the facets by ascending "transition times" z>. The images of the 
facets F, ordered in the same way, yield a simplicial shelling of C since the projection 
preserves the face relation in the complex. The construction of the shelling is illustrated 
by Figure HI 

It is not difficult to produce a point x in int(C'), but one may need several attempts to 
ensure that the transition times are all different. Instead we choose x only once and then 
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Figure 4. The line shelling 



replace it by a point infinitely near to x. This trick is known as "simulation of simplicity" 
in computational geometry (see 10). 

For the next lemma it is convenient to replace the integral support forms Op of the 
bottom faces by their rational multiples pp = —Of/of(v), v = (0, . . . , 0, — 1 ) G M. d+l as 
above. These are normed in such a way that Pf(v) = — 1 (and pp/op > 0). 

Lemma 13. Let the bottom facets ofC' be ordered by the following rule: F <F ifpp(x) < 
Pp{x) or Pf[x) — Pp{x) and pp precedes pp in the lexicographic order on (R d+1 )*. 
Then the bottom facets of C' form a shelling in this order. 

Proof. Note that there exists a weight vector w E M. d+l such that pp precedes pp- in the 
lexicographic order if and only Pf{w) < pp(w). For sufficiently small e > our ordering 
is identical with that obtained from the inequality pp(x + £w) < pp(x + £w). 

The transition time t F of the ray (x + £w) + M+v with the linear subspace spanned by 
F is given by 

p F (x + £w) . , 
t F = ~ , v =Pf (x + £w , 

Pf(v) 

and we have indeed ordered the facets by increasing transition times. □ 

Remark 14. After the mathematical foundation for the computation of Hilbert functions 
has been laid in Lemmas [TTI and [T3l we describe the essential details of the implementa- 
tion. 

(51) Normaliz computes the support hyperplanes of C — these are needed anyway — and 
extracts the extreme integral generators from the given set of generators in order to use 
the smallest possible system of generators for C' . 

(52) The support hyperplanes of C' are computed by Fourier-Motzkin elimination with 
simplicial refinement as described in Section HI It is here where the simplicial refinement 
shows its efficiency since the bottom (and top) facets of C' are kept simplicial by a suitable 
"dynamic" choice of the weights. 

Note that the vertical facets of C', namely those parallel to v, cannot be influenced by 
the choice of weights. They are determined by the facet structure of C. 

(53) Once the support hyperplanes of C' have been computed, the bottom facets are 
ordered as described in Lemma [[3] Let C\ < ■ ■ • < C,„ be the correspondingly ordered 
simplicial cones that triangulate C. In order to apply Lemma QT| we have to find the 
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intersections C, fl {C\ U ■ ■ • UC ( -_i). To this end we do the following: we start with an 
empty set and in step i (i= 1, . . . ,m) we insert the facets of C, into (i) If a facet is 
already in & ', then it is contained in C\ U ■ ■ • U C,-_i . Since it can never appear again, it is 
deleted from & . (ii) Otherwise it is a "new" facet and is kept in & . 

7. Cutting cones by halfspaces 

The primal algorithm of Normaliz builds a cone C by starting from and adding the 
generators xi,...,x n successively. The algorithm we want to discuss now (esentially due 
to Pottier Ifl4l0 builds the dual cone C* successively by staring from and adding genera- 
tors Ai, . . . , A s . On the primal side this amounts to cutting out the cone C from 0* = M. d by 
successively intersecting the cone reached with the halfspace Ht, i= l,...,s, until one 
arrives at C. 

If one wants to compute the Hilbert basis of C via this construction, then one has to 
understand how to obtain the Hilbert basis of an intersection D fl H + from that of the 
cone D. 

Since we start from the full space W 1 and we cannot reach a pointed cone before having 
cut it with at least d halfspaces, we use the general notion of a Hilbert basis as introduced 
in Section[2] (In the following we do not assume that C or C* is a full-dimensional cone.) 
Of course, in addition to the Hilbert basis B of M = C fl Z d , we also need a description of 
the group U(M) by a Z-basis. 

The halfspace H + is given by an integral linear form A, H + = Hf. In the following 
the superscript + denotes intersection with Hf, and the superscript ~~ denotes intersection 
with H7 . 

There are two cases that must be distinguished: 

(a) A vanishes on U(M); in this case U(M+) = U(M~) = U(M). 

(b) A does not vanish on U(M); in this case U(M + ) = U(M~) is a proper subgroup 
of U(M) such that rankU(M+) = rankU(M) - 1. Moreover U(M)+ has a Hilbert 
basis consisting of a single element h, and then — h constitutes a Hilbert basis of 
U(M)~. 

Note that case (a) automatically applies if D is pointed. 

The following algorithm computes the Hilbert bases of M + , M and a basis of the 
group U(M + ) = U(M~), starting from a Hilbert basis B of M and a basis of U(M). 

(Dl) Compute a basis of U(M+) = U(AT ) = KerA| U(M). If U(Af+) = U(M), then 
we are in case (a). Otherwise rankU(M + ) = rankU(M) — 1 and we are in case 
(b). 

(D2) In case (b) supplement the basis of U(M + ) to a basis of U(M) by an element 

he\J(M)+. 
(D3) Set B = B. 

(D4) In case (b) replace every element x E Bq by x — ah where a = [A (x) /A (h)\ , and 

every element x <E B Q x — a(—h), a = |_A(— x)/X{h)\ . 
(D5) In case (b) replace Bo by Bo U {h, —h}. 
(D6) For i > set 

B i = B i „iU{x+y:x,yeB i - h A (x) > 0, A(j) < 0,x+y ^ 0}. 
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Figure 5. Successive cuts with halfspaces 



(D7) Replace Bf by its auto-reduction Bf in D + , and B i by its auto-reduction fi ; in 

D , and let Bi = BfuB^. 
(D8) If Bi = Bi-i, then we are done, Bf x is a Hilbert basis of D + , and fir. 1 is a Hilbert 

basis of D . 

The construction is illustrated by Figure [5J base elements of the unit groups have been 
marked by a circle, Hilbert basis elements by a square. 

We have to prove the claim contained in (D8), and we state it as a lemma. 

Lemma 15. There exists an z > 1 such that Bi = fi ( -i, and in this case Bf = Hilb(M + ), 
fir = ffilb(Af-). 

Proof. Let B^ = \JT =0 Bi. We will show that Bf generates M+ modulo U(M+) and fi TC 
does the same for M . In other words, we claim that for every x G M + there exist 
«1, . . . , u r G fii such that 

x-(«i + "- + « r ) GU(M + ), (7.1) 

and the corresponding statement holds for fi^ and M . 

Suppose this claim has been proved. Then Bf contains a Hilbert basis of M + since it is 
a system of generators modulo U(M + ). Since the Hilbert basis contains only irreducible 
elements (an irreducible element will pass step (D7) above) and is finite, there must be an 
i for which fi^ 1 contains the Hilbert basis (in fact, equals it). Then Bf = Bf v Increasing 
i if necessary, we also have fir = B7,, and then fi, = fi,_i. Conversely, if fi, = fi ( -i, then 
B+_ j = Hilb(M+) and fir t = Hilb(AT ). 

We (have to) prove the crucial claim simultaneously for M + and M , considering the 
more complicated case (b). The proof for case (a) is obtained if one omits all those 
arguments that refer to h. 

We use induction on tdegx, the total degree with respect to M. We can assume that 
x E M + since the argument for x G M~ is analogous. If tdegx = 0, we have x G U(M). 
But then x — ahE U(M + ), since h is a Hilbert basis of U(M) + modulo its group U(M + ) 
of invertible elements. Moreover, h G fii by construction. 

Suppose that tdegx > 0, and note that x has a representation 

jc=(ifi + --- + if r ) + (vi + --- + v a ) + (wi + -" + w,) modU(M+) (7.2) 
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modulo U(M + ) in which Uj, v^, wi E B x and A (w/) > 0, A (v^) = and A (wi) < 0. In fact, 
since Boo contains a Hilbert basis of M, we can find such a representation modulo U(M), 
and adding /z or — /z sufficiently often, we end up in U(M + ). 

Among all the representations (17.21 ) we choose an optimal one, namely one for which 

A(«i H h w r ) is minimal. If we can show that t = for this choice, then we are done. 

Note that only one of h or —h can appear in an optimal representation; otherwise canceling 
h against —h would improve it. 

Clearly, if t > 0, then r > as well, since otherwise A(x) > is impossible. Consider 
the representation 

x=(u 1 +w 1 ) + (u 2 + ---+u r ) + (v 1 + ---+v s ) + (w 2 + --- + w t ) modU(M+) (7.3) 
modulo U(M+). 

If u\+w\ belongs to .Boo we are done, since A(«i + w\) < A (wi), regardless of the sign 
of X(u\ + w\). 

Otherwise u\ + yv\ is reducible in step (D7). Assume u\ + w\ E M + (an analogous 
argument can be given if u\ +w\ EM~). Then there exists y E B+ such that (u\ +w\) —y E 
M + . Note that y = h is impossible: by construction, all elements z of B x different from 
h and -h have |A(z)| < X(h), so X{u\ +w\) < X(u\) < X{h) and {u\ +w\) -h<£ M + . 
But all elements of Boo different from h and — h do not belong to U(M) and therefore have 
positive total degree in M. Then tdeg(ai +w\ — y) < tdeg(«i +w\). Thus we can apply 
induction to (u\ +w\) —y, representing it modulo U(M + ) = U(M~) by elements from 
B+. Since y E B+, we obtain a representation for u\ + w\ . Substituting this representation 
into (17.31) again yields an improvement. This is a contradiction to the choice of (|7.2I) . and 
we are done. □ 

While the description of the algorithm given above is very close to the implementation 
in Normaliz, we would like to mention some further details. 

Remark 16. (a) It is clear that in the formation of B, in step (D6) one should avoid the 
sums x + y that have already been formed in an earlier "generation". 

(b) When a sum x + y has been formed, it is immediately tested against reducibility 
by B^j or BJ v respectively. The elements that survive are collected, and the remaining 
reduction steps are applied after this collection. 

This "generation driven" procedure has the advantage that we can apply the rather 
efficient reduction strategy of Section [3] 

(c) Sometimes an element is reduced by one that is created in a later generation. How- 
ever, this happens rarely. 

(d) When a sum z = x + y is formed and belongs to Bf, then we store A (x) with z (anal- 
ogously if x + y E M~). Suppose that z survives the reduction. Then it is not necessary to 
form sums z + w with A (w) < —A (x) since we would have x + w, z + w E M , and x + w 
clearly reduces z + w. This trick diminishes the number of sums to be formed in higher 
generations considerably, but does not help in the formation of B\, which is usually (but 
not always) the most time consuming generation. 

(e) Normaliz uses a heuristic rule to determine the order in which the hyperplanes are 
inserted into the algorithm. It is evidently favorable to keep the sets B ; small as long as 
possible. 
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(f) In a future version of Normaliz we will also try a hybrid approach in which the 
algorithm for the local Hilbert bases is chosen dynamically. 

We conclude the article by a comparison of the primal algorithm of Normaliz and the 
algorithm of this section. 

Remark 17. (a) Normaliz has two input modes in which the cone C is specified by in- 
equalities (and equations). In these cases the user can choose whether to apply the primal 
algorithm (first computing a system of generators of C) or the dual algorithm described 
in this section. It is not easy to decide which of the two algorithms will perform better 
for a given C. The bottleneck of the primal algorithm is certainly the computation of a 
full triangulation (if it is done). The size of the triangulation is mainly determined by 
the number of support hyperplanes of the subcones of C through which the computation 
passes. However, if it can be found, the (partial) triangulation itself carries a large amount 
of information, and the subsequent steps profit from it. 

We illustrate these performance of the primal algorithm by two examples, one for which 
it is very fast, and another one that it cannot solve. 

(i) The example small from the Normaliz distribution is defined by a 5-dimensional 
lattice polytope with 190 vertices, 32 support hyperplanes, and 34,591 lattice points. Its 
normalized volume is 2,276,921, and the triangulation contains 1593 simplicial cones 
(if computed in the mode "normal"). About 230,000 vectors survive the local reduc- 
tion, and are sent into global reduction, leading to the Hilbert basis with 34, 591 vectors. 
(The number of candidates for global reduction caries considerably with the triangula- 
tion; those derived from shellings seem to behave worse in this respect.) Run time with 
Normaliz 2.2 (the currently public version) on our SUN Fire X4450 is 8 sec (and 19 sec 
if the h- vector is computed). 

(ii) The example 5x5 from the Normaliz distribution describes the cone of 5 x 5 "magic 
squares" [1], i.e., 5x5 matrices with nonnegative entries and constant row, column and 
diagonal sums. The cone of dimension 15 has 1940 extreme rays and 25 support hy- 
perplanes. The subcone generated by the first 57 extreme rays (in the order Normaliz 
finds them) has already 30,290 support hyperplanes. After 104 extreme rays we reached 
56, 347 support hyperplanes (and we stopped the program). 

(b) The main obstruction in the application of the dual algorithm is the potentially 
extremely large number of vectors it has to generate. Even if the Hilbert basis of the 
final cone C is small, the Hilbert bases of the overcones of C through which the algorithm 
passes may be extremely large, or one has to compute with medium size Hilbert bases 
in many successive overcones. Some data on the behavior of the algorithm on the two 
examples from (a) — now (i) is hard, and (ii) is easy: 

(i) For the lattice polytope the dual algorithm (staring from the support hyperplanes) 
needs 3540 sec. One of the intermediate Hilbert bases has cardinality 145,098. There- 
fore the number of elements of B\ at the insertion of the next hyperplane can safely be 
estimated by 10 9 . 

(ii) After 20 hyperplanes have been inserted, the size of the Hilbert basis of the cone 
reached is 228, and the values for the subsequent cones are 979, 1836, 2810, 3247, and 
finally 4828. Computation time is 2 sec. 
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(c) If the Hilbert basis of C = M+jci H \-x n is to be computed, the primal algorithm 

builds an ascending chain 

= C C Ci c ■ ■ • c c n = c, 

with a corresponding descreasing chain 

(R d )* = C* Q D C\ D • ■ O c* = c*. 

For the cone Z) = Dy=i me dual algorithm proceeds in exactly the opposite way, build- 
ing an increasing chain 

= D* CDIC-CD*=D\ 
of dual cones, with a corresponding decreasing chain 

R d = D D Di D ■ • • D D, = D. 

In both cases, the complexity is determined by the decreasing chains of overcones of C* 
and D, respectively. These overcones are hard to control only by the internal data of C or 
D*. 

Of course, if n = 1940 and s = 25 as in example (ii), then the choice is easy, but example 
(i) with n = 190 and s = 32 illustrates that the sole comparison of n and s does in general 
not help to pick the better algorithm. 

We conclude by presenting the following table which contains experimental test data 
we have obtained for computing the Hilbert basis with Normaliz version 2.2, as well as 
data obtained from our tests with 4ti2 version 1.3.2. The system 4ti2 ifTOl . [fTTI contains 
a somewhat different implementation of the dual algorithm. The table shows that our 
version is certainly comparable in performance. 



name 


input 


dim 


#gen 


#supp 


#HB 


t primal 


t dual 


r4ti2 


cut. in 


supp 


5 


83 


25 


4,398 


0.15 


3.4 


620 


small.in 


gen 


6 


190 


32 


34,591 


8 


3,540 


3,230 


medium.in 


gen 


17 


40 


3,753 


217 


11 


oo 


CO 


4x4.in 


equ 


8 


20 


34 


20 


0.002 


0.001 


0.01 


5x5. in 


equ 


15 


1,940 


47 


4,828 


oo 


2 


2.4 


6x6. in 


equ 


24 


97,548 


62 


522,347 


oo 


87,600 


345,600 



The first column refers to the name of the input file in the Normaliz distribution. The 
second column describes the type of input, namely generators, support hyperplanes, or 
system of egwations. In the latter case the cone is the intersection of the solution space 
with the nonnegative orthant. The third column contains the dimension of the cone, and 
the following three list the number of its generators, support hyperplanes and Hilbert 
basis elements. The last three columns contain computation times for Normaliz primal, 
Normaliz dual and 4ti2 (measured in seconds). For the application of Normaliz dual or 
4ti2 to input of type "gen", we first computed the dual cone separately (or extracted it 
from the output of the primal algorithm). Normaliz primal, when applied to any type of 
input, does the necessary dualization itself. 

We thank Christof Soger for measuring the computation times. 
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